Topology Induced Coarsening in Language Games 
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We investigate how very large populations are able to reach a global consensus, out of local 
"microscopic" interaction rules, in the framework of a recently introduced class of models of semiotic 
dynamics, the so-called Naming Game. We compare in particular the convergence mechanism for 
interacting agents embedded in a low-dimensional lattice with respect to the mean-field case. We 
highlight that in low-dimensions consensus is reached through a coarsening process which requires 
less cognitive effort of the agents, with respect to the mean-field case, but takes longer to complete. 
In 1-d the dynamics of the boundaries is mapped onto a truncated Markov process from which 
we analytically computed the diffusion coefficient. More generally we show that the convergence 
process requires a memory per agent scaling as N and lasts a time jV 1+2//d in dimension d < 4 (the 
upper critical dimension), while in mean-field both memory and time scale as N 3 ^ 2 , for a population 
of N agents. We present analytical and numerical evidences supporting this picture. 
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The past decade has seen an important development 
of the so-called Semiotic Dynamics, a new field which 
studies how conventions (or semiotic relations) can orig- 
inate, spread and evolve over time in populations. This 
occurred mainly trough the definition of Language inter- 
action games 0,0 in which a population of agents is seen 
as a complex adaptive system which self-organizes 

3] 

as a 

result of simple local interactions (games) . The interest 
of physicists for Language Games comes from the fact 
that they can be easily formulated as non-equilibrium 
statistical mechanics models of interacting agents: at 
each time step, an agent updates its state (among a cer- 
tain set of possible states) through an interaction with its 
neighbors. An interesting question concerns the possibil- 
ity of convergence towards a common state for all agents, 
which emerges without external global coordination and 
from purely local interaction rules 0. 0. |(| In this Let- 
ter, we focus on the so-called Naming Games, introduced 
to describe the emergence of conventions and shared lex- 
icons in a population of individuals interacting with each 
other by negotiations rules, and study how the embed- 
ding of the agents on a low-dimensional lattice influences 
the emergence of consensus, which we show to be reached 
through a coarsening process. The original model was 
inspired by a well-known experiment of artificial intelli- 
gence called Talking Heads gj, in which embodied soft- 
ware agents develop their vocabulary observing objects 
through digital cameras, assigning them randomly chosen 
names and negotiating these names with other agents. 

Recently a new minimal version of the Naming Game 
endowed with simplified interactions rules 0] has been 
introduced, that reproduces the phenomenology of the 
experiments and is amenable to analytical treatment. In 
this model, N individuals (or agents) observe the same 
object, trying to communicate its name one to the other. 
The identical agents have at their disposal an internal 
inventory, in which they can store an unlimited number 
of different names or opinions. At the initial time, all 



individuals have empty inventories, with no innate terms. 
At each time step, the dynamics consists of a pairwise 
interaction between randomly chosen individuals. Each 
agent can take part in the interaction as a "speaker" or 
as a "hearer". The speaker transmits to the hearer a 
possible name for the object at issue; if the speaker does 
not know a name for the object (its inventory is empty), 
it invents a name to be passed to the hearer [l^. while 
in the case it already knows more synonyms (stored in 
the inventory), it chooses one of them randomly. The 
hearer's move is deterministic: if it possesses the term 
pronounced by the speaker, the interaction is a success, 
and both speaker and hearer retain that name as the right 
one, canceling all the other terms in their inventories; 
otherwise, the new name is included in the inventory of 
the hearer, without any cancellation. 

The mean-field (MF) case has been studied in [9|: the 
system initially accumulates a large number of possible 
names for the object since different agents (speakers) ini- 
tially invent different names and propagate them. Inter- 
estingly however, this profusion of different names leads 
in the end to an asymptotic absorbing state in which all 
the agents share the same name. 

Although this model leads to the convergence of all 
agents to a common state or "opinion" , it is interesting 
to notice the important differences with other commonly 
studied models of opinion formation 3> S @ • For exam- 
ple, each agent can potentially be in an infinite number 
of possible discrete states (or words, names), contrarily 
to the Voter model in which each agent has only two pos- 
sible states 0. Moreover, an agent can here accumulate 
in its memory different possible names for the object, i.e. 
wait before reaching a decision. Finally, each dynamical 
step involves a certain degree of stochasticity, while in 
the Voter model, an agent deterministically adopts the 
opinion of one of its neighbors. 

In this Letter, we study the Naming Game model on 
low-dimensional lattices: the agents, placed on a regu- 
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lar ci-dimensional lattice, can interact only with their 2d 
nearest neighbors. Numerical and analytical investiga- 
tions allow us to highlight important differences with the 
mean-field case, in particular in the time needed to reach 
consensus, and in the effective size of the inventories or 
total memory required. We show how the dynamics cor- 
responds to a coarsening of clusters of agents sharing a 
common name; the interfaces between such clusters are 
composed by agents who still have more than one possi- 
ble name. 

Relevant quantities in the study of Naming Games are 
the total number of words in the system N w (t), which 
corresponds to the total memory used by the agents, the 
total number of different words Na(t), and the average 
rate of success S(t) of the interactions. Fig. ^ displays 
the evolution in time of these three quantities for the low- 
dimensional models, compared to the mean-field case. 

In the initial state, all inventories are empty. At short 
times therefore, each speaker with an empty inventory 
has to invent a name for the object, and many differ- 
ent words are indeed invented. In this initial phase, the 
success rate is equal to the probability that two agents 
that have already played are chosen again: this rate is 
proportional to t/E where E is the number of possible 
interacting pairs, i.e. N(N — l)/2 for the mean-field case 
and Nd in finite dimensions. S(t) grows thus N times 
faster in finite dimensions, as confirmed by numerics. At 
larger times however, the eventual convergence is much 
slower in finite dimensions. 

The curves for N w (t) and Nd(t) display in all cases a 
sharp increase at short times, a maximum for a given time 
tmax and then a decay towards the consensus state in 
which all the agents share the same unique word, reached 
at t conv . The short time regime corresponds to the cre- 
ation of many different words by the agents. After a time 
of order N, each agent has played typically once, and 
therefore O(N) different words have been invented (in 
fact, typically N/2): the total number of distinct words 
in the system grows and reaches a maximum scaling as 
N. Due to the interactions, the agents accumulate in 
memory the words they have invented and the words 
that other agents have invented. In MF, each agent can 
interact with all the others, so that it can learn many 
different words, and in fact the maximal memory neces- 
sary for each agent scales as N MF with olmf = 0-5 0, so 
that the total memory used at the peak is ~ iV 15 , with 
many words shared by many agents, and t max ~ N MF 
with Pmf = 1.5. Moreover, during this learning phase, 
words are not eliminated (S(t) is very small) so that the 
total number of distinct words displays a long plateau. 
The redundancy of words then reaches a sufficient level 
to begin producing successful interactions and the de- 
crease of the number of words is then very fast, with a 
rapid convergence to the consensus state. In contrast 
in finite dimensions words can only spread locally, and 
each agent has access only to a finite number of different 




FIG. 1: Time evolution in mean-field and finite dimensions 
of the total number of words (or total used memory), for the 
number of different words in the system, and for the average 
success rate. N = 1024, average over 1000 realizations. The 
inset in the top graph shows the very slow convergence in 
finite dimensions. 
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FIG. 2: Scaling of the time at which the number of words is 
maximal, and of the time needed to obtain convergence, in 1 
and 2 dimensions. 



words. The total memory used scales as N, and the time 
tmax to reach the maximum number of words in the sys- 
tem scales as N ad with a\ = a-x = 1 (Fig. [5}. No plateau 
is observed in the total number of distinct words since 
coarsening of clusters of agents soon start to eliminate 
words. 

Furthermore, the time needed to reach consensus, 
tconv, grows as 7V^ d with (3i ~ 3 in d = 1 and fa — 2 in 
d = 2, while Pmf — 1.5 (Fig. |2J|. We will now see how 
such behaviors emerge from a more detailed numerical 
and analytical analysis of the dynamical evolution. 

FigEl reports a typical evolution of agents on a one- 
dimensional lattice, by displaying one below the other 
a certain number of (linear) configurations correspond- 
ing to successive equally separated temporal steps. Each 
agent having one single word in memory is presented by 
a colored point while agents having more than one word 
in memory are shown in black. This figure clearly shows 
the growth of clusters of agents having one single word by 
diffusion of interfaces made of agents having more than 
one word in memory. The fact that the interfaces remain 



FIG. 3: Typical evolution of a one-dimensional system (N = 
1000). Black color corresponds to interfaces (sites with more 
than one word). The other colors identify different single 
state clusters. The vertical axis represents the time (1000 x N 
sequential steps), the one-dimensional snapshots are reported 
on the horizontal axis. 

thin is however not obvious a priori: an agent having e.g. 
two words in memory can propagate them to its neigh- 
bors, leading to possible clusters of agents having more 
than one word. 

In order to rationalize and quantify such evolution, we 
consider a single interface between two linear clusters of 
agents: in each cluster, all the agents share the same 
unique word, say A in the left-hand cluster and B in the 
other. The interface is a string of length m composed of 
sites in which both states A and B are present. We call 
C m this state (A + B) m . A Co corresponds to two di- 
rectly neighboring clusters (• • • AAABBB ■ • •), while C m 
means that the interface is composed by m sites in the 
state C = A + B {■■■ AAAC ■ ■ ■ CBBB ■■■). Note that, 
in the actual dynamics, two clusters of states A and B 
can be separated by a more complex interface. For in- 
stance a C m interface can break down into two or more 
smaller sets of C-states spaced out by A or B clusters, 
causing the number of interfaces to grow. Numerical in- 
vestigation shows that such configurations are however 
eliminated in the early times of the dynamics. 

Bearing in mind these hypotheses, an approximate ex- 
pression for the stationary probability that two neigh- 
boring clusters are separated by a C TO interface can be 
computed in the following way. In a one-dimensional line 
composed of N sites and initially divided into two clus- 
ters of A and B, the probability to select the unique Co 
interface is 1/N, and the interacting rules say that the 
only possible product is a C\ interface. Thus, there is 
a probability po.i = 1/N that a Co interface becomes a 
Cl interface in a single time step, otherwise it stays in 
Co- From C\ the interface can evolve into a Co or a C2 
interface with probabilities pi t o — gfj and pi_2 — 977 re- 
spectively. This procedure is easily extended to higher 
values of m. The numerics suggest that we can safely 
truncate this study at m < 3. In this approximation, the 



FIG. 4: Truncated Markov process associated with inter- 
face width dynamics - schematic evolution of a Co interface 
• ■ ■ AAABBB cut at the maximal width m = 3. 

problem corresponds to determine the stationary proba- 
bilities of the Markov chain reported in FigQ]and defined 
by transition matrix 
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in which the basis is {Co, C\, C2, C3} and the contribu- 
tion from C3 to C4 has been neglected (see FigQJ. 
The stationary probability vector P = {P , Pi, P2, P3} 
is computed by imposing P(t + 1) — P(t) = 0, i.e. 
{M T - I)P = 0, that gives P = 133/227 » 0.586, 
Pi = 78/227 w 0.344, P 2 = 14/227 « 0.062, P 3 = 
2/227 w 0.0088. Direct numerical simulations of the 
evolution of a line • • - AAABBB ■ ■ ■ yields P ~ 0.581, 
Pi = 0.344, P 2 = 0.063, P 3 = 0.01, thus clearly confirm- 
ing the correctness of our approximation. 

Since our analysis shows that the width of the inter- 
faces remains small, we assume that they are punctual 
objects localized around their central position x: in the 
previously analyzed case, denoting by xi the position 
of the right-most site of cluster A and by x r the po- 
sition of the left-most site of cluster B, it is given by 
x = X '+ Xr . An interaction involving sites of an inter- 
face, i.e. an interface transition C TO — > C m ', corresponds 
to a set of possible movements for the central position 
x. The set of transition rates are obtained by enumer- 
ation of all possible cases: denoting by W(x — > x ± 8) 
the transition probability that an interface centered in x 
moves to the position x ± 8, in our approximation only 
three symmetric contributions are present. We obtain 
W(x - x ± i) = ^vP> + jfPl + }P2 + ^P 3 , W(x - 
x±l) = 27vP 2 +2lvP3, W(x -» x±\) = 2^P 3 . Using the 
expressions for the stationary probability Po, . . . , P3, we 
finally get W(x - x±\) = W(x -» x±l) = ^ 

and W(x — > x ± |) = 22 \ N - 

The knowledge of these transition probabilities allows 
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FIG. 5: Evolution of the position of an interface 
• • ■ AAABBB ■ ■ : Top: evolution of the distribution V(x,t). 
Bottom: evolution of the mean square displacement, showing 
a clear diffusive behavior {x 2 } — 2D exp t/N with a coefficient 



0.224 in agreement with the theoretical prediction. 



us to write the master equation for the probability V{x 1 i) 
to find the interface in position x at time t, which, in the 
limit of continuous time and space (i.e. writing V(x, t + 
1) - V(x,t) w 5t^Z(x,t), while V(x + 5x,i) » Vix.t) + 

Sx%(x,t) + G£££(M)), -ads = 
where D = 401/1816 ~ 0.221 is the diffusion coefficient 
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401/1816 

(in the appropriate dimensional units (5x) 2 /5t). 

These results are confirmed by numerical simulations 
as illustrated in Fig. [S] where the numerical probabil- 
ity V(x,t) is shown to be a Gaussian around the ini- 
tial position, while the mean-square distance reached 
by the interface at the time t follows the diffusion law 
(x 2 ) = 2D exp t/N with D exp ~ 0.224 » D. The dynami- 
cal evolution of the Naming Game on a one-dimensional 
lattice can then be described as follows: at short times, 
pairwise interactions create O(N) small clusters, divided 
by thin interfaces (see the first lines in Fig[3J|. We can 
estimate the number of interfaces at this time with the 
number of different words in the lattice, that is about 
N/2. The interfaces then start diffusing. When two in- 
terfaces meet, the cluster situated in between the inter- 
faces disappears, and the two interfaces coalesce. Such a 
coarsening leads to the well-known growth of the typical 
size £ of the clusters as t 1 ^ 2 . The density of interfaces, 
at which unsuccessful interactions can take place, decays 
as 1/y/t, so that 1 — S(t) also decays as 1/y/t. Moreover, 
starting from a lattice in which all agents have no words, 
a time N is needed to reach a size of order 1, so that 
in fact £ grows as y/t/N (as also shown by the fact that 
the diffusion coefficient is D /N) , which explains the time 
tconv ~ N 3 needed to reach consensus, i.e. £ = N. 

This framework can be extended to the case of higher 
dimensions. The interfaces, although quite rough, are 
well defined and their width does not grow in time, which 
points to the existence of an effective surface tension. 
The numerical computation of equal-time pair correlation 
function in dimension d = 2 (not shown) indicates that 



the characteristic length scale £ grows as y/t/N (a time 
0(N) is needed to initialize the agents to at least one 
word and therefore to reach a cluster size of order 1), in 
agreement with coarsening dynamics for non-conserved 
fields 0. Since t conv corresponds to the time needed 
to reach £ = N 1 ^, we can argue t conv ~ N 1+2 / d , that 
has been verified by numerical simulations in d — 2 and 
d = 3. This scaling and the observed coarsening behavior 
suggest that the upper critical dimension for this system 
isd = 4 0. 

In conclusion, the study of the low-dimensional Nam- 
ing Game using statistical physics methods provides a 
deeper understanding of the macroscopical collective dy- 
namics of the model. Wc have shown how it presents a 
very different behavior in low-dimensional lattices than 
in mean-field, indicating the existence of a finite upper- 
critical dimension. Low-dimensional dynamics is initially 
more effective, less memory per node is required, pre- 
venting agents from learning a large part of the many 
different words created. The dynamics then proceeds by 
the growth of clusters by coarsening, yielding a slow con- 
vergence to consensus. In contrast with other models of 
opinion dynamics (e.g. the Voter model 0, E^h the 
Naming Game presents an effective surface tension that 
is reminiscent of the non-equilibrium zero-temperature 
Ising model 01- I n this respect, it seems interesting 
to investigate the dynamics of the Naming Game in 
other topologies, such as complex networks in which each 
node have a finite number of neighbors combined with 
"long-range" links Acknowledgments: The au- 
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